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Multi-Period Network Rate Allocation with 
End-to-End Deiay Constraints 

Mohammad H. Hajiesmaili, Ahmad Khonsari, and Mohammad Sadegh Talebi 


Abstract —QoS-aware networking applications such as real-time streaming and video surveillance systems require nearly fixed 
average end-to-end delay over long periods to communicate efficiently, although may tolerate some delay variations in short periods. 
This variability exhibits complex dynamics that makes rate control of such applications a formidable task. This paper addresses rate 
allocation for heterogeneous QoS-aware applications that preserves the long-term end-to-end delay constraint while, similar to Dynamic 
Network Utility Maximization (DNUM), strives to achieve the maximum network utility aggregated over a fixed time interval. Since 
capturing temporal dynamics in QoS requirements of sources is allowed in our system model, we incorporate a novel time-coupling 
constraint in which delay-sensitivity of sources is considered such that a certain end-to-end average delay for each source over a 
pre-specified time interval is satisfied. We propose DA-DNUM algorithm, as a dual-based solution, which allocates source rates for the 
next time interval in a distributed fashion, given the knowledge of network parameters in advance. To overcome the slow convergence 
of dual-based DA-DNUM algorithm, we propose another fast alternative solution based on the recently-proposed distributed Newton 
method. Also, we extend and address the problem in a case that the problem data is not known fully in advance to capture more realistic 
scenarios. Through numerical experiments, we show that DA-DNUM gains higher average link utilization and a wider range of feasible 
scenarios in comparison with the best, to our knowledge, rate control schemes that may guarantee such constraints on delay. 

Index Terms —Data Networks, Network Utility Maximization, Rate Allocation, End-to-End Delay, Convex Qptimization. 
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1 Introduction 

N owadays, a plethora of computer applications 
have emerged that evince delay-sensitivity, mainly 
in the form of some guarantee on the end-to-end delay. 
Despite instantaneous delay sensitivity shown by some 
applications, one may identify several others that only 
concern the average end-to-end delay over some interval 
of interest. A notable instance is media streaming where 
end-to-end delay, averaged over a pre-specified interval, 
is obliged not to exceed some threshold to ensure con¬ 
tinuous playback. Some other examples include real-time 
WSNs and networked control systems. In such scenarios, 
due to temporal variations in both source traffic and 
network characteristics, we face an ever increasing need 
to accomplish rate allocation capable of capturing such 
d3mamicity. 

As a promising framework. Network Utility Maxi¬ 
mization (NUM) has been exploited in several network 
resource allocation scenarios; see, e.g., 0-@- In its 
simplest form, NUM concerns a network that supports 
a set of sources and links. Each source is associated 
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with a utility as a function of its rate and transmits its 
packets through a route, which is a subset of the links 
in the network. The fixed capacity of links and routing 
structure dictate a set of linear capacity constraints. The 
goal of the NUM problem is to find source rates that 
maximize the aggregate utility of the network given 
capacity constraints. 

A number of studies have thus far incorporated end- 
to-end delay in the NUM model |[4)-[[ll|. In these works, 
end-to-end delay either is included in the objective 
function of NUM (e.g., |j^, pl)| , |TlH) or introduced 
some constraints to the NUM problem (e.g., 0, 

@). In §, delay is incorporated to the objective func¬ 
tion and therefore, delay plays its role as a penalty 
to the utility function. Based on a delay-sensitive util¬ 
ity function introduced in authors in [10|, 0 


aim to propose some application-oriented rate allocation 
schemes employing an alternative utility definition. Both 
approaches, however, show incompetency to provide 
some guarantee for delay. Despite these studies, NUM 
framework is intrinsically incapable of capturing tempo¬ 
ral variation in network characteristics especially when 
these characteristics evolve with time scales comparable 
to those of the underlying dual-based algorithms. Gen¬ 
erally speaking, (single-period) NUM along with delay 
constraints is subject to limited degrees of freedom, and 
as a result, one may face a broad range of infeasible 
problems. 

The conquest of variability-aware NUM-based ap¬ 
proaches was further followed by p3) , where it in¬ 
troduced Dynamic NUM (DNUM) as a multi-period 
extension of NUM. Indeed, DNUM simply considers the 
network utility aggregated over a finite time interval 
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and thereby takes into account temporal variations in 
utilities. Moreover, it allows linear constraints on source 
rates, referred to as delivery contracts, which may be 
construed as QoS constraints over the time interval. 
Such delivery contracts, however, are incompetent to 
capture more complicated key features such as queuing 
delays and jitter. In contrast to single-period NUM that 
suffers from limited degrees of freedom, DNUM offers 
several flexibilities. In particular, the former may face 
lofs of infeasible problems whereas fhe latter admifs 
relatively larger set of feasible problems yef higher fofal 
aggregated utility. 

In this paper, we propose a variant of DNUM fhaf 
sfrives fo allocafe source rafes so as fo satisfy consfrainfs 
on end-fo-end delays as well as capacify consfrainfs. 
Toward fhis, fhe main confribufions of fhis paper are 
summarized as follows: 

> Builf upon DNUM framework, we characferize fhe 
average end-fo-end delay requiremenfs of sources as a 
sef of general and well-sfrucfured consfrainfs. Our model 
is a generalized version of fhe model fhat is builf on |j^, 
& and fhereby if avoids precise knowledge of under¬ 
lying packef arrival models and relies only on fhe firsf 
order derivative of fhe delay function. Generalizafion of 
fhe model of Q fo a multi-period sefup ushers in several 
flexibilities. The mosf promising one, perhaps, is fhaf if 
allows some degree of freedom fo sacrifice ufilify in some 
periods so as fo mainfain delay while compensating 
for if in some ofher periods. Secondly, our proposed 
formulation endows us fhe abilify of mainfaining several 
delay consfrainfs for each source, where each delay 
consfrainf concerns a particular time inferval of inferesf. 

> We develop a disfribufed algorifhm called Delay- 
aware Dynamic Network Utility Maximization (DA-DNUM) 
fhaf solves fhe problem granfed fhe knowledge of pa- 
ramefers for fhe nexf time inferval in advance. Our 
solution is based on dual decomposition approaches and 
since we concenfrafe on sfrongly convex delay functions 
and consequenfly casf fhe rafe allocafion as a convex 
opfimizafion problem, fhe problem can be efflcienfly 
solved in a disfribufed way fhanks fo exisfing dual-based 
approaches. 

[> DA-DNUM is in fhe cafegory of dual decomposition 
fechniques which generally suffer from fhe curse of 
slow convergence. This unpleasant property becomes 
more salient in the case of solving DNUM problems, 
where ahead of each time horizon, we musf solve fhe 
entire problem during all periods. To overcome fhe 
slow convergence of fhe dual-based solution, we devise 
anofher solufion approach using fhe recenfly-proposed 
disfribufed Newfon mefhod flSl which is a second order 
algorifhm fhaf achieves fhe opfimal solufion with faster 
convergence rate. 

[> Dependence of DA-DNUM on fhe precise knowl¬ 
edge of fufure network parameters stimulates devising 
another scheme that efficiently work under uncertainty 
of fhe paramefers. Toward fhis goal, we also invesfi- 
gafe fhe problem when fhe problem dafa is nof known 


fully ahead of fime. In particular, we construct another 
solution based on model predictive control p^ , for 
approximafely solving a variation of fhe problem, in 
which fhe link capacities are nof known in advance. 

> We verify fhe correcfness of our proposed solufions 
and DA-DNUM algorifhm by a sef of tracfable numer¬ 
ical experimenfs and give some comparison scenarios 
fo demonsfrafe ifs superiorify againsf fo fhe relevant 
state-of-the-art rate allocation schemes. As an interesting 
observation, our result corroborates that the proposed 
temporal formulation enlarges the set of feasible scenar¬ 
ios in comparison wifh ||^. 

The remainder of fhis paper is organized as follows. 
Firsf, in Secfion we briefly review fhe relafed work. 
In Secfion we infroduce fhe femporal-aware sysfem 
model, fhe characferizafion of delay consfrainfs, and 
problem formulation. In Secfion we derive fhe pro¬ 
posed iferafive algorifhm and prove fhe convergence of 
DA-DNUM. In Secfion ^ we infroduce anofher solu¬ 
fion fo fhe problem fo reduce fhe convergence of fhe 
disfribufed algorifhm. Secfion is devofed fo infroduce 
a solufion when fhe problem dafa is nof known in 
advance. Secfion]^ gives experimenfal resulfs and Secfion 
1^ is devofed fo conclusion and ouflining some fufure 
directions. 

1.1 Basic Notations and Terminoiogies 

Throughput the paper, we use the following notations. 
For any vector z (matrix Z), z > 0 (Z > 0) means 
that all components of vector z (matrix Z) are non¬ 
negative. The vector ej denotes the j-th unit vector. 
The operator ||.|| signifies standard Euclidean norm. The 
domain of a function / is denoted by dom /. Moreover, 
lyi is 1 if A occurs and 0 otherwise. Finally, [.]+ and [.]p 
defines the projection onto the positive orthant and set 
V, respectively. We also give some necessary definitions 
that can be found in, e.g., 0. 

Definition 1. A function /(.) is a G-Lipschitz function if 

|/(xi) - /(X2)| < G||xi - X 2 II, VX1,X2 e dom f. 

Definition 2. A convex function /(.) is K-strongly convex 
if and only if there exists a constant k > 0 such that the 
function /(x) — f |lx|p is convex. 

It can be easily seen that if /(.) is convex and satisfies 
||V/(.)|| < G, then it is G-Lipschitz. We remark that if 
/(.) is twice differentiable then /(.) is K-strongly convex 
if there exists constant k such that f (x.) — kI is positive 
semidefinite. 

2 Related Work 

In the recent years, many studies have employed NUM 
framework to propose efficient protocols and algorithms 
for network applications under different t 5 rpes of traffics, 
assumptions, and constraints (see Q and the references 
therein). In particular, by extending the basic single¬ 
period version of NUM framework, a number of studies 


3 


have incorporated end-to-end delay @-0 to address 
the requirements of the delay-sensitive traffic and ap¬ 
plications. In fhese works, end-fo-end delay eifher is 
included in fhe objecfive function of NUM (e.g., ||^, 
pO) , pd| , p^ ) or is augmenfed as consfrainfs fo fhe 
underlying optimization problem (e.g., @, 0, @). 


Delay as objective function. In 0, delay is incorpo¬ 
rated to the objective function and therefore, delay plays 
ifs role as a penally fo fhe ufilify function. Consequenfly 
fhe goal is fo simulfaneously maximize fhe aggregafed 
utility of all sources and reduce fhe end-to-end delays. 
Based on a delay-sensitive utility function introduced 
in [121, authors in pO] , pd] | aim to propose some 
application-oriented rate allocation schemes employing 
an alternative utility definition. Both approaches, how¬ 
ever, show incompetency to provide some guarantee for 
delay, fhereby fail fo be employed in QoS-aware applica- 
fions wifh hard long ferm average delay requiremenfs. 


Delay as constraint. In another set of works a 0. 
0/ P0 , fhe source delay is incorporafed as consfrainfs of 
fhe opfimizafion problems. By infroducing Virfual Link 
Capacify Margin (VLCM) fo characferize source delay as 
consfrainf of fhe problem, the authors in 0, p4) have 
proposed a joint rate allocation and scheduling scheme 
in multi-hop wireless networks. By a different approach 
in 0, another variant of NUM problem is formulafed fo 
address joint power and rate control. Moreover, in 0, 
using an elegant fluid model of multi-class flows wifh 
differenf delay requiremenfs, anofher disfribufed and 
sfable delay-aware algorifhm is proposed. Despife fhese 
single-period NUM-based sfudies, NUM framework is 
infrinsically incapable of capfuring femporal variations 
in network characferisfics especially when fhese charac- 
ferisfics evolve wifh fime scales comparable fo fhose of 
fhe underlying dual-based algorifhms. Generally speak¬ 
ing, (single-period) NUM along wifh delay consfrainfs 
is subjecf fo limited degrees of freedom, and as a resulf, 
one may face a broad range of infeasible problems. 
We will invesfigafe fhis phenomenon in defails in our 
experimenfs in Secfion 


To capfure d 5 mamics in nefwork and sources, NUM 
framework has been exfended fo fhe DNUM frame¬ 
work p3| fhaf supporfs time-varying characferisfics in 
nefwork model paramefers such as flow utilities, links 
capacities and routing mafrix. The DNUM framework 
has been exfended in differenf research areas | [20| , pT) . 
In |20[ , fhe time-varying nafure is utilized to consider 
temporal variations in modeling the utility function of 
fhe sources with video streaming applications. The au¬ 
thors in pl| have proposed another solution for DNUM 
based on disfribufed Newfon mefhods. To fhe aufhor's 
knowledge, fhis is fhe firsf work fhaf exfends fhe DNUM 
framework fo characferize fhe average delay require¬ 
menfs of sources in a general and well-sfrucfured way. 


3 Model and Problem Formulation 

3.1 Network Model 

Our model is based on fhaf of DNUM p^ , which 
considers rafe allocafion over a discrefe-fime inferval 
T = r}[^ We assume fhaf nefwork possesses 

a sef £ = of links shared among a sef 

S = {!,...,5'} of sources. We represenf fhe possibly 
time-varying roufing in fhe nefwork defined by routing 
mafrices Rt = [{Rt)is]LxS,t & T, whose elemenf {Rt)i8 is 
defined as follows: 


{Rt)is = 


if sfh source passes fhrough I af fime t 
ofherwise 


We lef cti denofe fhe capacify of link I af period t and 
ct = [cti]iGC be fhe vector of link capacifies af period t. 

Moreover, we lef Xgt G Xst be fhe transmission rate of 
source s af period t, where we define X^t = [wsijWsj] 
and Wst and Wst are fhe minimum and fhe maximum 
rates of source s af period t, respectively We further 
require 0 < Wst < Wst, We let X = [a^stjsxT be 

the rate matrix and define X = {X e : Xst € Xst}- 

A feasible rafe mafrix X fhen satisfies: X & X. The 
summary of fhe main nofafions of fhe paper is listed 
in Table [H 


TABLE 1: Key Notations 


Notation 

Definition 

T 

The set of fime slofs (period), T = \T\ 

C 

The sef of links, L = \C\ 

S 

The sef of sources. S' = 5 

Rt 

The roufing mafrix af period t 

Ctl 

The capacify of link 1 af period t 

o-ti 

Link margin of link 1 af period t 

D{-) 

The delay function of link 1 af period t 

^st 

The fransmission rafe of source s af f 

Wst 

The minimum rafe of source s af f 

Wst 

The maximum rafe of source s af f 

^st 

The end-fo-end queuing delay of 
source s af period t 

ICs 

The number of delay consfrainfs of 
source s, Ks = JCg 

Ms 

The delay indicator mafrix of source s 

dsk 

The average delay requiremenf of 
source s for ifs k's delay consfrainf 

Ust{') 

The ufilify function of source s at t 


3.2 Capacity Constraints 

To give capacity constraints, we first give the definition 
of link margin variables: For each link I and time period 
t, link margin variable au is defined as fhe difference 
befween capacify of link I and fhe maximum allowable 

1. The duration of each period t and the whole time horizon T is an 
application-specific design parameter. As an example, in a previous 
work |20| , video streaming is the underlying application, thus, each 
period is set according to the length of the video frames and the time 
horizon T is set according to the length of GOPs (Group Of Pictures). 
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flow passing through it |j^. Unlike Q, however, our 
setup does not admit schedulability constraints and 
hence we proceed to formulate link margin as follows. 
Consider conventional capacify consfrainf for link I af 
period t given by 

'^{Rt)isXst + (Xti = Cti and > 0. 

sGiS 

We fhen relax fhe equalify consfrainf above and esfablish 
fhe following consfrainfs for link I af period t: 

'^{Rt)isXst + cFti < Cti and au > 0. 

sGS 

The relaxafion above, fhough consfricfs resource usage 
(i.e., capacify), plays an imporfanf role in limiting fhe 
flow of link I and fhereby proves essenfially useful 
fo confrol fhe queuing delay of link 1. Infroducing 
cTt = [uti\i(^c and cr = [cTt]t(^r> we fhen represenf fhe 
capacify consfrainfs in a compacf way as 

RtXet + (Tt < ct and at >0, Vf S T. (1) 

These consfrainfs consfifufe a sef of 2T x L linear in¬ 
equalities. 


3.3 Average Delay Constraints 

Having defined link margin variables, we define D{ati) 
as fhe delay of link I af period t. Clearly, fhe way 
D{ati) depends on ati is defermined by fhe packef arrival 
process model. For insfance, for M/M/1 queuing model 
whose packef arrival is a Poisson process, we have 

D{ati) = ^, q>0. (2) 

Uti 

Anofher nofable insfance is fhe case of M/G/1 queuing 
model whose delay function is given in |0, p2) . 

In whaf follows, we lisf our assumptions on fhe delay 
function D{.y. 

Al. D{.) is fwice differenfiable. 

A2. D{.) is G-Lipschifz. 

A3. D{.) is K£)-sfrongly convex. 

A nofable example fhaf satisfies fhese assumptions is 
fhe delay function of l|^. We also remark fhaf fhese as¬ 
sumptions are valid for M/G/l-based arrival processes, 
fhereby cover fhe majority of exisfing queuing models. 

In fhe presenf sfudy we only consider queuing delays 
and hence, for each source s, we obfain fhe end-fo-end 
delay by simply adding up all link delays along fhe pafh 
of s. Wrifing (pst for fhe end-fo-end queuing delay of 
source s af period t, we gef 

4^st — Y,iRt)isD{ati). 
lec 

We furfher infroduce (f)^ = [(j)st]tGT- Nexf, we define 
fhe consfrainf on average end-fo-end delay as follows: 
Assume fhaf source s requires ifs average end-fo-end 
queuing delay over some inferval of inferesf 7 a ^ T 


wifh lengfh A be less fhan some consfanf d. This con¬ 
sfrainf is formally given by 

d. (3) 


To model a general scenario for fhe infroduced de¬ 
lay consfrainf, we assume fhaf each source s requires 
Kg delay consfrainfs of fhe form ||^, indexed by 
fc G /Cg = {1,..., Kg}. We furfher infroduce a real-world 
example on realizafion of fhis considerafion in a fypical 
mission-orienfed wireless sensor network scenario in 
Subsecfion 3.3.1 Each delay consfrainf k G ICg concerns 
a specific fime inferval. Overlap befween such infervals, 
however, is allowed. In order fo encode delay consfrainfs 
of fhe form (|^, for each source s, we infroduce fhe delay 
indicator matrix Mg = [{Mg)kt]K^xT as follows 


{Mg)kt = 


1 

G| 

0 


if fc-th delay constraint of s concerns t, 
otherwise. 


where Now, we can write the 

fc-th delay constraint of source s as 

^ 'X X[s)kt4^st — dgk-, 

t(^T 

where dgk is fhe average delay requiremenf of source 
s for ifs fc's delay consfrainf. Nofe fhaf fhe elemenfs 
of every row of Mg add up fo 1 and fherefore, we 
may inferpref fhe left hand side of fhe consfrainf above, 
like fhaf of l|^, as fhe end-fo-end queueing delay of s 
averaged over fime inferval {f G T : {Mg)kt = !}■ 
Moreover, letting d^ = [dsk]keK, yields fhe following 
vecfor represenfafion for delay consfrainfs: 


Mgcl)g < ds, Vs G S. (4) 


These consfrainfs consfifufe a sef of J2ses inequal- 
ifies fhaf are nonlinear in a. 


3.3.1 An Illustrative Example: Mission-Oriented WSNs 
To mofivafe fhe appropriafeness of fhe model above, 
we nexf provide a practical application of fhis model 
for mission-orienfed wireless sensor networks (WSN) 
| p3| , i.e. fhe case where fhere are several coexisting 
applicafions (henceforfh missions) in a WSN. Lef us look 
af a surveillance application fhaf employs various f 5 rpes 
of sensors such as video, motion detector, and thermal 
sensors fo provide assistive ambienf infelligence in e.g., 
disasfer recovery environmenfs. 

The naive approach is fo require each sensor fo pe¬ 
riodically fransmif fhe dafa af specific fime infervals. 
Albeif simple fo implemenf, fhis approach is inefficienf 
as each mission mighf possess parficular QoS require¬ 
menf in ferms of end-fo-end delay. For insfance, a video 
mission may demand for a long-fime delay consfrainf 
fo work efticienfly In confrasf, fhe fhermal mission may 
reporf fhe femperafure periodically on a regular basis 
and fhereby declares a shorf-ferm delay requiremenf af 
cerfain periods. 
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The network designer therefore needs to select net¬ 
work parameters properly to achieve the best efficiency. 
Besides ofher paramefers, one could sef 7a = T for fhe 
real-time video mission, as if records and sfreams dafa 
fo fhe sink continuously The value of 7a has a periodic 
shape for fhe fhermal sensor. Say, in fhe case of T = 60, 
we can define 7 ai = {1,2,3}, = {21,22,23}, and 

Taj = {41,42,43}. In fhis respecf, fhis sensor reporfs ifs 
dafa in 3 differenf sfeps as mentioned above. 

In summary, one can identify several ofher applicafion 
scenarios (such as in emerging Infemef of Things (loT) 
or networked confrol sysfems), wherein differenf com- 
pefing goals (missions in some confexfs) wifh diverse 
QoS characferisfics coexisf under a unified applicafion, 
buf, wifh heferogeneous requiremenfs. 


3.4 Optimization Probiem 

We associate a utility function Ust{xst) to each source s 
at period t. Assumptions on the utility functions are: 
A4. For every s and t, Ust{ ) is continuous, monotoni- 
cally increasing, and twice differentiable. 

A5. For every s and t, —Usti ) is Kfz-strongly convex. 


Similar to [13|, we define fhe network ufilify [/(.) as 
fhe sum of all utilities over fime horizon T as follows: 

u{x) = J2J2^Ax,t). 

Now, we casf fhe rafe allocation problem as 


P1: max 

xex.,a->o 


U{X) 


subjecf fo: 

RtXet + cTt ^ Cf 

< ds, 

= J2{Rt)isD{au) 


Pst 


ytGT, 

Vs G 5, 

Vs G s,yt G r. 


IGC 


Firsf we highlighf fhaf consfrainfs of P1 consfifufe a 
compacf sef. Hence, af leasf one opfimal solution exisfs. 
Furfhermore, P1 is a sfrongly convex opfimizafion prob¬ 
lem. An immediafe consequence of fhis properfy is fhaf 
fhe opfimal solution is unique. We remark fhaf PI is non- 
separable due fo coupled delay consfrainfs. If's worfh 
nofing fhaf in fhe lack of average delay consfrainfs, 
problem P1 degenerafes fo DNUM problem of |13| 
wifhouf delivery confracfs. In fhe above formulation, we 
address QoS requiremenfs mainly fhrough end-to-end 
delay constraints and thus avoid augmenting delivery 
contracts, i.e. linear constraints on source rates over T. 
We stress, however, that the solution procedure below 
permits having delivery contracts as well. We further 
note that for fhe case of T = 1 and Kg = l,Vs, P1 
reduces fo problem formulation in Q (for fhe case of 
rafe allocafion only). 


4 Optimal Rate Allocation Algorithm 

In fhis secfion, we solve P1 and develop a disfribufed 
rafe allocafion algorifhm. We nofe fhaf sfrong dualify 


1241 holds for P1 and hence we can solve if fhrough ifs 
dual. Welef A* = [Xti]i(^c and fig = [psfcJfcGK, respectively 
denofe fhe Lagrange mulfipliers (dual variables) associ- 
afed fo fhe capacify consfrainfs for period t and average 
delay consfrainfs for source s. Moreover, we infroduce 
A = [AtJtgT- and fi = Now, we give fhe partial 

Lagrangian of P1 in ||^, where 


lec 

^tl A ^ ^ {Ms)ki{Rt)lsflsk- 


s^S kGK-s 

To solve problem P1, we derive fhe dual function 
g{X, fi) in and esfablish fhe dual problem associafed 
fo P1 as | |17| [: 

D1 : min o(A, u). 

A> 0 ,m >0 

Given A and fi, lef X* = [xJJtxS and cr} = 
be fhe maximizers of maximization problems in (|^. To 
derive fhese solufions, firsf nofe fhaf parfial derivatives 
of fhe Lagrangian are given by: 

BT 

= u'g,{xgt)-x\ ys,yt 


dxgt 
BT 

^=fi^^D'{au) + Xtu 
oau 


ytyi. 


The maximizers are sfationary point of fhe Lagrangian. 
Therefore, fhrough preliminary manipulations we gef 

<*(A)=[C7-i(A^‘)]^ 

Xti 




(-^ 


X,t 

+ 


Vs, Vf 

ytyi. 


Qne consequence of sfrong convexify of P1 is fhaf fhe 
dual function g(A, fi) is differentiable in its domain. 
Hence, we can employ the gradient projection method 
1171 to solve D1. Using Danskin's Theorem flT) , partial 
derivatives of dual function g{X, fi) are given by: 

^ = Q, - au - Y, VI G £, Vf G T, (7) 


dXu 

dg 

dg'sk 


t^'T' s^S 


= Vs G 5,V/c G/Cs. ( 8 ) 

teT i&c 

Using fhese, for dual variable updafe needed for gradi- 
enf projection mefhod we gef 


(i+i) 


A 


h'sk ~ 


Af +7 ( - cti 


\s£S 


,U) 


i^sk + 7 XI - d. 

XtGTlGC 


viG £,vfGr, 

sk 


\fsGS,\/kGJCs, 

where ~ 7 > 0 

is a sufficienfly small sfep size. 
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L{X, cr, A, /x) = ^ ^ Ustixst) {RtXet - c* + cr*) - ^ /xj - d^) (5) 

t^T seS teT seS 

= J2J2 i^stixst) - x^*xst) - XI51 + Xtmi) + X +X 

t^T seS teT lec teT seS 


D(X,ti) 


max L(X, cr. A, u) 

X&X,rT>0 


max XX {Ustixst) - A'**a;st) + 

t^1~ s^S 


max X X + Xtmi) ■ 

<t !>0 ' ^ ^ 

teT Zg£ 


( 6 ) 


Note that proper selection of step size 7 is crucial for 
guaranteeing the convergence of the iterative solution 
above. 


Theorem 1. Assume that 7 satisfies 0 < 7 < ^, where 


Q = TL 


1 


+ — 1 + GTL 


G 


2 


N*'- 


ItlJ2k, 


1 




(9) 


Amax = maxAti, Pmin = min p^fc- 
t,l s,kGK:s 

Then, starting from any initial point, the limit point 
{X*,a*,p*,X*) of the sequence 

generated by the aforementioned iterative solution is primal- 
dual optimal and {X*,a*) is the unique optimal solution to 

P 1 . 


Proof: First, we briefly review the descent lemma for 
solving the problem min^ /(z) using gradient method 
with constant step size dzi- We let z* be the minimizer 
of fhe problem. If V/(z) is a Q'hipschitz function, then 
the sequence {z^'^^k>o defined by 

^(fe+i) = z(fe) _ 7 V/(z('=)) ( 10 ) 


dxst 

duii\x*) 


dX'^* 

dX^* 


dan 

- ( 

Xti 

dXti 

dXti \ 

p*’ 

dati 

- 

Xti 

dp*’ 

dp*’ \ 

p*’ 


Ufti^st) 


, 'is€S,'iteT, 


1 


p^^D'fatiY 

Xti 

J {ptiyD'Yati)' 


ytGTXl e c. 


Using these equations, for fhe elements of fhe Hessian 
we obtain 


dXt'i'dpsk 


d 


dX, 




teT lec 


= -(Rf) 


I's 


dat'v dD{at'v) 


dXt'v dat’v 
{Rt'hs , Dfcrw) 

^t'V D'fat'i'Y 


rdps'k' r)psk 


dps'k‘ 




t)isD{au) 

teT leC 

dati dD{ati) 


teT lec 


dps 


dati 




teT lec 


dp*’- ^ dou ^ dD{ati) 

dps'k’ dp** dan 


teT leC 


Xti ^ D'jcrti) 
{p**Y D'fatiY 


converges to z* provided that 0 <7<i . By this lemma, 
to prove the convergence of fhe algorithm, it suffices fo 
find consfanf Q that satisfies Lipschitz condifion. Lef us 
define v = [Ai,..., A-r, Pi,..., /xg]. Then, we should find 
constanf Q such fhaf Vg{v) is Q'Lipschitz. Equivalently, 
we can resort to find an upper bound for fhe £ 2 -norm 
of fhe Hessian of g{i'). The Hessian of g{i'), henceforth 
denoted by H, is a {TL + JYs^sY^y-iTL + 
matrix, whose U'-element is: 

_ d^gju) 
duidvj 


Recall that the partial derivatives of g{v) w.r.f. dual 
variables are given by equations l|^ and ||^. Before 
proceeding to calculate the elements of fhe Hessian, 
observe fhaf 


d'^giv) _ dcrti \ 

dXtwdXti ~ dXtm ^''^dXtw 

sGo 

p*’D"{au) 4 S 9 X-* 

_ !{(«',;')=(«,;)} {Rt)is{Rt')i'B 

p**D"{au) "45 U'fYxst) ’ 


d’^gjv') ^ dati D 'I 

dps'k’dXti dps'k' dps'k' 

S(z.O 

_ dp*’ ^ dati 
dps'k' dp*’ 

_ {Ms')k't{Rt)is'Xti 1 

{ptiY D"{auY 

Using infroduced values in fhe theorem, we can easily 
establish the following bounds: 
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dl^s'k' dfksk 


dXfi'dXti 


d^g{^) 

^^‘s'k'^Xtl 


< 

G 


(11) 

pmin^n 

1 

< 

'^max^ 

y^{Ais')k't{Rt)is[Rt)is 

i^jc. 

gLnl^D 

< 

X^^^GTL 

(12) 

g^i^D 

< 

1 


— yxRt)is{Rt')i's 

^ sGS 

pmin^O 


< 

1 


— (13) 

Ku 

A^min^D 


< 

1 

..2 .. 


(14) 




Next, we find an upper bound for fhe f 2 ‘norm of fhe 
Hessian H. To simplify fhe analysis, we use fhe following 
resulf fo upper bound ||iT|j 2 - Recall fhaf for mafrices Ai G 
Ijnxn^ j = , iT, we have 

K K 

\\J2a\\<J2\\a,\\. 

i=l i=l 


In lighf of fhis resulf, we consider fhe following de¬ 
composition of H: 



fjUD 

fjGD 




jjUa) 





pjUD 

0 ■ 

-t 

0 



0 

0 

0 

0 

-t 

0 

0 ■ 

-t 

0 

0 

ffUa) 

0 

0 



(15) 


which yields: 


1^^112 < 


fjDD 

0 ■ 

0 

0 


I 2 + 


■ 0 

fjGD 

0 

0 


II 

0 

0 ■ 

Ho -u II 

■ 0 

0 

II 


0 

l|2 + II 

0 



| 2 - 


(16) 


Moreover, recall fhat for any mafrix A we have: ||^||2 < 
a/PIIiPIIoo, where \\A\\i is fhe maximum column-sum 
mafrix norm of A, and ||A||oo is fhe maximum row-sum 
mafrix norm [2^ . Then, since for p = 1, 00 , we have fhat 



0 ■ 

0 

0 




we can further provide an upper bound for fhe right 
hand side of < [T^ as follows: 

+ y||iT(M)||i||iJ(AN||^ + ^J\\HM\\^\\HM\\^ 

(17) 


We nexf obfain upper bounds fo each ferm in fhe righf 


hand side of (171. For using (11 1 and (13 1 , we gef 

< TL^ ^ 


Mmin^D 

l^u , 

' 1 

S' 

^ A^min^D 

Ku 


From ( [11) and ( |l^ , for we gef 

||iy(MM)||i < GTL^XI^y" Ks, 

< GTL^^^y K,. 


For ( |TT) and (111 yield 


And using (11 1 and ( [l4| for ^ we obfain 

TL 




gininl^D '' 






grain^D 


Lef 


Q = TL 


1 S 

- 1 - 


ItlY,k. 


GTL 


G 


'^max \ ' 
2 / ^ 
gminl^D y 


1 


pmin^O 


Then, using ( [T7[ | we obfain 

\\H\\2<Q. 


(18) 


Hence, fhe right hand side of fhe above equation can be 
viewed as fhe Lipschifz consfanf for Vg{v), and conse¬ 
quently, if we require 0 < 7 < fhen the algorithm 
converges to the primal-dual point of P1. 

□ 

Given appropriafe 7 , updafe equafions for dual vari¬ 
ables converge fo minimizers of D1. Sfrong dualify then 
guarantees that optimal values of D1 and PI coin¬ 
cide and fhaf X* and cr* can be obfained accordingly. 
Nexf, we give a disfribufed iferafive algorifhm, named 
Delay-Aware Dynamic Network Utility Maximization (DA- 
DNUM), fhaf is based on a disfribufed implemenfafion 
of fhe above iterafive solution. Since gradienf-based 
algorithms are not finitely convergent, in DA-DNUM 
algorithm we introduce a parameter th to stop the 
iterative procedure. DA-DNUM algorithm relies on both 
the knowledge of network paramefers in advance of fime 
inferval T and abilify of explicif/implicif exchange of 
dual variables between sources and links (more precisely, 
between each source s and links on the path of s). The 















































































pseudo-code of DA-DNUM is shown as Algorithm 1. 


Algorithm 1: DA-DNUM Algorithm 

1 Acquire network parameters for the next time horizon T. 

2 Initialize X“,cr°,A°, and fjP. 


3 while maxi \x 


lax 1 I 
,i,t L 


,(j+i) 


Jj) I 


^ 0 + 1 ) 


4i'‘\] < th do 


At each link I, for each period t, obtain and 

update: 


A 


dt+i) 


0 + 1 ) _ 
ti ~ 


D' 






At each source s, for each period t, obtain and 

compute: 

^ 0 + 1 ) 


10 end 




f^sk 


Ml 

0k2XT ■ 

QksxT 

O/fixS 

M 2 

■■ OifgXT 

O/fixS 

OiCaxT • 

.. Ms . 


( 20 ) 


with K = Es=i ^s- Moreover, we define the following 
vectors: 

> Source rate vector of length TS' at all time periods 
denoted by a; = 

> Delay upper bound vector of length K for all 
sources denoted by d = [ds]sGS- 

> Delay vector of length TS for all sources denoted 
by 0 = [(lushes- 

> Link capacity vector of length TL at all time periods 
denoted by c = [ct]ter- 

> Link margin vector of length TL at all time periods 
denoted by cr = [(Tt]t^r- 

We next rewrite problem P1 using the introduced 
vectors as 


DA-DNUM is devised by solving rate allocation prob¬ 
lem using first order methods. In general, first order 
methods suffer from slow rate of convergence. This 
unpleasant property becomes more salient in the case 
of solving DNUM problems, where ahead of each time 
horizon T, we must solve the entire problem during 
all ts. There is a fast alternative to solve problem P1; 
the second order algorithms p5] achieve the optimal 
point with faster convergence rate. In a nutshell, in state- 
of-the-art distributed Newton method the direction of 
dual adjustment is the negative gradient scaled by the 
inverse of the Hessian of which results in a faster 
convergence compared to the first order gradient based 
algorithms. 

5 Distributed Newton Method: A Fast 
Solution 

In this section, we develop an alternative solution to 
problem P1 that converges substantially faster at the 
expense of doing more computations. Our work toward 
this goal is to employ the recently-proposed distributed 
Newton method in and extend it to consider our 
problem. 

5.1 Reformulation of problem PI 

In order to solve the problem P1 using distributed 
Newton method, we first reformulate problem P1 so as 
to possess only equality constraints. 

For the sake of proper explanation of problem P1 
by matrix notations, we represent the routing matrix 
Rtlxts as Eq. 

Similarly, we define a block diagonal matrix M^xts 
for the second set of end-to-end average constraints as 
follows: 


P2: max U(X) 

XGX,rT>0 

subject to: 

Rx + (T < c, (21) 

Mcj) < d. (22) 

Observe that problems P2 and PI are equivalent. The 
next step is to reformulate the problem P2 into a problem 
with only equality-constrained as follows: 

P3: min f{z) 

Z 

subject to: Az = b. 


In problem P3 we impose two additional concepts: 
slack variables and logarithmic barrier function. To express 
problem P2 into equality-constrained problem we intro¬ 
duce two slack variables y and w associated to capacity 
constraint •HD and delay constraint ( p^ , respectively. 
The vector y of length TL is non-negative slack variable 
such that Rx + a + y = c, where yu represents the slack 
capacity of link I at time t. Similarly, for the constraint 
1 221, we introduce variable w of length K as the non¬ 
negative slack variable vector of second set of con¬ 
straints, i.e., we get Mcj) + w = d, and Wk represents the 
slack variable associated with the fc-th delay constraint 
among all sources. 

We introduce a decision variable z, which is the con¬ 
catenation of source rates x, link margin vectors cr, slack 
variable of link capacities y, and slack variable of delay 
constraints w, i.e.. 


2 : = [a;'^,cr'^,y'^,u;Y 


Moreover, in problem P3, p > 0 is a coefficient 
for the barrier function, vector b=[c^,dJ]^, and A 
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- 1 

Olx(T-I) 

(^ 2)1 

{Ri)2 

OLx(r-i) 

Olx(T-I) 

(/?2)2 

{Ri)s 

{R2)s 

Olx(T-I) 

OlxI 

(19) 

.Olx(T-I) 

{Rt)i 

Olx(T-I) 

[Rt)2 

■ 0lx{T-1) 

{Rt)s 



is a {TL K) X {TS + 2TL + K) matrix defined by 
A=[F'^ G''']''', where = [i? Itl Itl Otlx/t] and 

G= [M 0kx2TL /if]. Finally, we get 

T S TS+2TL+K 

/(^) = 

t=l s=l i=l 

Now, the problem is equivalently formulated in an 
appropriate form such fhaf we can apply fhe fasf dis- 
fribufed Newfon mefhod. 


5.2 Distributed Newton Method 

In this subsection, we present an alternative solution 
based on Newton method with equality-constrained 


problem |24 Ch. 10]. In equality-constrained Newton 
method the initial point must be feasible (i.e., 2 : € 
dom / and Az = b). Hence, at the first step, we assume 
that we know a feasible vector 2 :. For example, one such 
initial vector could be the minimum rate demand of each 
source at each time period for the rate part of 2 ;. Indeed, 
this is the case that the average delay requirements are 
large enough; thereby the minimum rate demand of 
sources at all time periods are feasible points. 

The Newton algorithm produces a minimizing se¬ 
quence z{j - 1 - 1 ), j = 1,... given by 

z{j + l) = z{j) + S{j)Az{j), 

where S{j) is a positive step size and Az{j) is the 
Newton direction that is given by 


Az{j) = -H-\Wf{z{j)) 
{AH-^A^Mj) = -AH-^Vfiz{j)). 


( 24 ) 

In Eq. < [2^ , vector <jj{j) of length TL + K is the dual 
(price) vector associated with the equality constraint 
of problem P3. The first TL elements are related to 
the capacity constraints of all time periods and the K 
remaining elements correspond to the average delay 
constraints. Since utility functions are strongly concave 
and primal vector z{j) is bounded, one can show that 
Hj and AHJ^AJ are both invertible fl^. 

The iterations of Eq. <[23) and Eq. ([24)i converge to the 


optimal solution of problem P3, which is an equivalent 
form of P1. Eor given values of w(j) for all links in the 
path of source s in time periods and all of the elements 
associated to the delay constraints with source s, the 
value of Az{j) can be computed locally at source s. 
However, the evaluation of inverse matrix [AH~^A^)~^ 
requires global information, and therefore, tu(j) cannot 
be computed in a decentralized marmer. In what follows, 
based on |15| we present an elegant Newton method for 
distributed computation of dual vector a;(j). 


TABLE 2: Function Definitions 


Function 

(Domain and 
Rangel/Description 

l{v) = v\L 

{1,...,TL}^{1,...,L} 

The link of v 

II 

SO 

{i,...,TL}^{i,...,r} 

The time period of v 

II 

{1,...,TS}^{1,...,T} 

The time period of v 

II 

{1,...,TS}^{1,...,S} 

The source of v 

p(v) = 1 X] — '*^1 


p{v) is the source that nth 
delay constraint is 
associated to it. 


To obtain a distributed update equation for dual vari¬ 
able, we present a mechanism based on matrix splitting 
techniques. Let us denote by uj{j,n) the value of cu 
at n-th dual iteration at the j-th primal step. Eor the 
sake of notational simplicity, we define some subsidiary 
functions as summarized in Table Moreover, we define 
= [H~% and \'f{z)(zi) = [Vf{z){z^)]i. 

We define the weighted sum of the dual variables 
associated with links that are in route of source s at 
period t by 

lec 

Similarly, for the delay part of constraints, we define 
n) as the weighted sum of dual variables associ¬ 
ated with the active delay constraints of source s at time 
t by 


'^stij,n) = Hj ^{xst) y] {Ms)ktUJTL+j{j,n). 




Using the introduced definitions, we can rewrite the 
left hand side part of Eq. ( p4) in the form of Eq. < [2^ and 
Eq. 1^. 

Using Eq. |[2^ and Eq. and matrix splitting tech¬ 


niques presented in [15|, now we are ready to obtain 
an iterative way toward distributed computation of u), 
which is summarized in Theorem 


Theorem 2. Let Cj be a diagonal matrix with 
[Cj\vv = A^]vv> Bk = — Cj he a symmetric 

one, Bj be another diagonal matrix with diagonal entries 
[Bj]yy = [Bj]vi, and the diagonal matrix Cj as 

the sum of Cj Bj. For each primal iteration j, the dual 
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^ ^ ^ (j, yi) ~l~ (j, Tl)] -\- H j (jJt{v)l{v)^^l{v) + {t{v) — l)L{jf'^) 

s^S 

for i; = 1,..., TL and 

[-AH~^A^u}{j,n)]y = ^(Mp(„))„t[np(„)t(j,n) + 4'p(„)t(j, n)] + H~'^{w^)ujTL+v{j,n) (26) 

tGT 

for r; = 1,..., 


CO^; (/c, 71-f- 1) — k ]vv \Ck\vv^vi^:k ^ ^(^;7l)]^ 

^ st{v))'^ f (^yi(^v)t{v)^'^f {^{^)) (jJl{v)t{v)^j ( 27 ) 

sG 5 7 

for V = 1,... ,TL and 

71-1-1) — ]t;2; (^5 7l) -j- (/c, n) ^4 U){k.f 7l)]^ 

+ [Cfe]™co„(fc,n)^(Mp(„))„*iJ-i(aip(,) 0 V/( 2 :(fc))(xp(,),) +i?,-'(^'")V/(^(fc))(z™)') (28) 

ter 7 




for V 

sequence {a;„(j, rz)} generated by the iterations Eq. ^T7\ and 
Eq. converges to the solution of Eq. < [^ as n ^ oo. 

Finally, in if has been shown fhaf fhe updafe 
equafions described in Eq. | [27) and Eq. < [28) could be 
calculafed using merely local information af sources, 
fhereby fhe corresponding algorifhm is implemenfed in 
a disfribufed fashion. 


6.1 MPC-based solution 

To obfain a decenfralized sfochasfic solufion, we con- 
sfrucf our solufion based on Model Predictive Confrol 
(MFC) |T^ . To calculafe fhe source rafes (xsts) and link 
margin values (aus) for any parficular period r, insfead 
of solving problem P1, we consfrucf and solve problem 
P4 as follows 


6 A Solution with limited future 

KNOWLEDGE 

The solutions presenfed in Sections and are based on 
fhe assumpfion fhaf fhe problem dafa (inpuf paramefers) 
for fhe enfire time horizon is available ahead of time. De¬ 
pendence of fhese solufions on fhe precise knowledge of 
fufure nefwork paramefers sfimulafes devising anofher 
scheme fhaf efficienfly works under uncertainfy of fhe 
paramefers. In fhis section, we exfend our solufion in 
a way such thaf fhe problem dafa is nof fully known in 
advance. Wifhouf loss of generalify we assume fhaf only 
fhe link capacifies are revealed at the begirming of each 
period. Nofe fhaf fhis approach could be exfended fo 
capfure fhe case fhaf ofher paramefers such fhaf source 
ufilifies are nof known ahead of time. Our approach 
in fhis section is based on a causalify consfrainf such 
fhaf fhe source rafes af period f is a funcfion of fhe 
link capacifies up fo period t. We further note that 
this is a convex stochastic problem p6) , where the goal 
is to maximize the expected aggregated utility of all 
sources subjecf fo fhe capacify, average delay, and causal¬ 
ify consfrainfs. Like fhe conventional NUM problems 
this problem could be efficiently tackled by centralized 
approaches, but, here we are interested in decentralized 
schemes. 


P4: max _ y^,y^Uet{xst) 

Xst,seS,teT^ ^ ^ 

teT^ sgS 

subject to: 

R.YX e^ -\- (7.j. ^ C 7 -, 

iJtXet-I-cTj < c(f|r), yt&T'", 

Ms4>s < ds, Vs e S, 

fst ~ ^iRt)isD{ati), Ws € S,yt €T, 
lec 

where = {t + l,...,r} and 

c(f|r) = i?[ct|ci,..., Ct], f e T'^ is the expected value of 
link capacifies, given fhe enfire information at period r. 
Consequently, in problem P4, at any period r the whole 
information about link capacities before and af period 
T is revealed. Eurfhermore, for fhe fufure periods we 
use fhe conditional mean values of link capacifies. In 
addition, since each source can declare several average 
delay consfrainfs, if is conceivable fhaf some delay 
consfrainfs are expired before beginning of period r, 
i.e., fhe acfive inferval of fhe consfraint is sfarfed and 
finished before period r. Anofher sifuation is when a 
confracf has already been acfive. Thaf is, fhe sfarf fime 
is "< t", while fhe final fime is "> r". Here, fhe source 
rafe for periods < t are already calculafed, lef denofe 
fhem by x'g^,s S S,t e r}. Then, fhe confracf 

inequalify is inferprefed as follows: fhe source rafes for 
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t < T are taken to be x'g^. And so, this part is fixed and 
the constraint should be satisfied for fhe remaining parf 
in period t > t. 

Finally, problem P4 is a parficular version of problem 
PI and bofh fhe opfimal algorifhms in Secfions and 
could be employed fo find ifs opfimal solufion. Buf, in 
each period r, we pick fhe opfimal source rafe and link 
margin values for jusf fhe fime slof r and fhen we solve 
fhe problem again for fhe remaining fime slofs. For each 
fime slof, fhe opfimal values of fhe previous periods are 
used as inpuf paramefers. 

7 Experimental Results 

This secfion is devofed fo fhe experimenfal resulfs. Firsf, 
we concenfrafe on a fracfable network fopology fo verify 
fhe correcfness of DA-DNUM. Second, by describing two 
comparison scenarios, we invesfigafe bofh fhe superior- 
ify of our work againsf similar approaches as well as 
scalabilify of DA-DNUM. 


7.1 Experiment 1: Simple and Tractable Topology 

In order to facilitate the detail discussion of the results, 
we have chosen a network with time-invariant routing 
and topology shown in Fig.[^ We set T = 10 and cu and 
C 4 t are chosen uniformly at random from [4, 6 ], and C 2 t 
and Cat are randomly and uniformly drawn from [4,10]. 
We choose Ust{xst) — loga;st for all s and t. Also, we as¬ 
sume that D{z) = i for all links that represents M/M/1 
queuing model. We give delay indicator matrices as well 
as vectors d^, s G 5 below: 


Ml = 

1 

'l 

1 

1 

0 

3 ^ 

0 

0 

0 

0 

Ma = 

^ X 

6 


1 

1 

1 

Mg = 

0 

0 

1 

1 

M4 = 


0 

0 

1 

1 

di = 

[2 1]", 


d2 

= 


0 0 0 0 0 0 

0 1 1 1 0 oj ’ 

1 1 0 0 0 0 ], 

11110 0 ], 

1 1 0 0 0 0 ], 

da = 2, dri = 2.5. 


We stress that the above delay indicator matrices 
imply that for f = 9,10, there is no delay constraint and 
thus for these periods, P1 degenerates to DNUM |13] 
without delivery contracts. 

Fig. [^displays the rate allocation result obtained from 
DA-DNUM algorithm with 7 = 0.01 and th = 0.01. 
For the sake of comparison. Fig. also shows the rate 
allocation result of DNUM (without delivery contracts), 
which is obtained by solving PI after removal of delay 
constraints. Fig. 2(a) shows final source rates of the two 
cases. As we expect. Fig. |2(a)|exhibits the same values for 


^ Link 1 ► ^ — Link 2 ► ^ 

__ ^ _ Source 1 ____ 


- Source 2 - 


both DA-DNUM and DNUM for t = 9, 10. By contrast, 
for t = 1,..., 8 source rates obtained by DA-DNUM are 
lower than those provided by DNUM. This stems from 
existence of at least one delay constraint in any of these 
periods. 

End-to-end queuing delays (j)st for all s and t are 
depicted in Fig. 2(b) To achieve higher system-wide 


aggregate utility, DA-DNUM allows some fluctuations in 
source delays during periods, while the average delays 
do not exceed d^. This flexibility in rate allocation due 
to the time-varying algorithm design can yield a wider 
feasible rate allocation schemes in comparison with the 
single-period NUM that is expressed in the next sub¬ 
section by another experiment. Finally, Fig. 2(c) shows 
link traffics, link margins, and the amount of under¬ 
utilized link capacities. Clearly, in periods t = 9, 10, all 
links possess zero link margins. On the other hand, for 
t = 1 ,..., 8 , positive values for link margin variables (for 
at least one link) evince that there is at least one active 
delay constraint imposed by the sources. 

We also have executed another experiment with the 
same settings of the previous one to verify the cor¬ 
rectness and analyze the convergence behavior of dis¬ 
tributed Newton solution that is proposed in Section 
As expected, the optimal rate and link margin values 
are the same for DA-DNUM and distributed Newton 
method, since both solutions are optimal. However, DA- 
DNUM converges to the optimal values nearly after 
320 iterations with th = 0.01. This value is about 34 
iterations for the distributed Newton method, which 
reveals a significantly faster convergence rate (in terms 
of number of iterations) compared to the DA-DNUM. 

We also investigate the effectiveness of the MFC- 
based solution that is proposed in Section Toward 
this, we used the same topology and settings as the 
previous one. But, in each period we should decide for 
the expected link capacity values. For all rs, we use 
ci(t|T) = C 4 (tlr) = 5 and C 2 {t\T) = C 3 (tlr) = 7. We 
compare the results of problem P4 with the knowledge 
of the current and the previous periods with the global 
problem P1 with the entire knowledge of the horizon. 
The resulting source rates and link margin values are 
quite similar. To illustrate the accuracy of the subop- 
timal MFC-based solution we report the utility values 
obtained by two solutions. The aggregated utility value 
for MFC-based solution is 36.16; while the utility value 
obtained by the DA-DNUM solution (as the solution of 
problem P1) is 37.01 which evinces 2.2% difference. 


7.2 Experiment 2: Comparison Scenario 

We next compare DA-DNUM with the algorithm pro¬ 
posed in (by assuming fixed capacities) in a large- 
scale scenario. We remark that the algorithm proposed 
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Fig. 2: Results of Experiment 1 


in Q is based on the single-period version of NUM that 
is customized in delay-sensitive setting. Consequently, 
Single-period NUM in algorithm of ]|^ persuades us to 
solve T separate problems for the entire T. We consider 
a line topology with 200 links and 198 sources (Fig. 
whose 200 x 198 routing matrix is given in below: 
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In addition, the other parameters are listed in Table I. 
To clearly exhibit the different behavior of DA-DNUM, 
we intentionally set up only 2 average delay constraints 
for source 1 (the source with all links on its path) and 
source 2 (the one that traverses through first 4 links). 

To exhibit the flexibility of DA-DNUM, this ex¬ 
periment simply obliges a minimum rate demand as 
= 5. This means that the minimum rate requirement 
of source 1 at period 2 is 5. The aforementioned mini¬ 
mum rate demand is in conflict with the average delay 
requirement since the higher rate results in higher end- 
to-end delay according to the limited capacity of links. 
Nonetheless, DA-DNUM easily remedies this conflicting 
situation by assigning the declared minimum rate to si 
at t 2 , thus enduring a larger short-term delay (around 85 
instead of di = 50). Thanks to supporting time-coupled 
system model, DA-DNUM allocates proper rates to this 
source in other periods, so as to maintain the average 
delay below 50. In contrast, the single-period algorithm 
of ||^ fails for this scenario since the underlying NUM 
becomes infeasible. This simple experiment signifies the 
relatively wider set of feasible problems of DA-DNUM. 
One may construct several other feasible scenarios for 
DA-DNUM that are infeasible for the problem of Q. 

7.3 Experiment 3: Random Topology 

We examine DA-DNUM for the case of more complex 
randomly generated topologies. We run DA-DNUM and 


TABLE 3: Parameters of Experiment 2 


Parameter 

Value 

S 

198 

L 

200 

T 

50 

cti,t &T,l & C 

[8,12] kbps 

ks,s & {1, 2} 

1 

M„,s& {1,2} 

[1/50]ix50 

ks,s & {3, , 198} 

0 

Ms,s e (3, ...,198} 

[0]lx50 

ds, s e (1, 2} 

50 


TABLE 4: Parameters of Experiments 3 


Parameter 

Value 

S 

20 

L 

20 

T 

20 

T,l&C 

20 kbps 

ks, s £ S 

1 

Ms, seS 

random 

da, s £ S 

[4.6| 


algorithm of |[^ for a scenario with a random topology 
comprising 20 sources and 20 links (see Table I for the 
parameters). As it allows temporal fluctuations in source 
delays, DA-DNUM yields slightly better link utilization 
compared to |[^: The under utilized link capacity aver¬ 
aged over all links and all periods for the algorithm of 
@ is 4.06 whereas it is 3.91 for DA-DNUM. Hence, 3.7% 
improvement is obtained. Consequently, by these two 
experiments, we show both wider range of feasibility 
along with better resource utilization of DA-DNUM 
against existing single-period approaches. 

8 Conclusion and Future Directions 

To ameliorate QoS experience in real-time networking 
applications in terms of guaranteeing fixed average end- 
to-end delay over long periods, we addressed a dy¬ 
namic NUM problem with source-driven time-coupled 
constraints on average end-to-end delay. We proposed 
two set of solutions, first, a DA-DNUM algorithm as 
the dual-based distributed solution of the formulated 
optimization problem. Second, we devised another solu¬ 
tion based on the recently-proposed distributed New¬ 
ton method to improve the slow convergence rate of 
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the DA-DNUM. DA-DNUM allocates source rates in a 
way that achieves the maximum network-wide utility 
aggregated over time interval while satisfying capacity 
and delay constraints. Numerical experiments exhibited 
that, compared to existing schemes, DA-DNUM admits 
relatively wider feasible scenarios along wifh higher 
resource ufilizafion. This enhancemenf originafed from 
mulfi-period problem sefup fhaf allows shorf-ferm delay 
flucfuafions while keeps long-ferm value around fhe 
required one. Obfained resulfs sfimulafe furfher research 
activities. A promising line is fo invesfigafe fhe solufion 
when link delay function is a non-convex funcfion which 
is nof far from fhe realify in fhe case of complicafed 
packef arrival models. In addition, we plan fo exfend fhis 
work in wireless scenarios fo joinfly consider fhe delay- 
aware rafe allocation and link scheduling as a cross-layer 
solufion design. 
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